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FOREWORD 


A  major  research  area  for  the  U.S.  Army  Research  Institute  for  the 
Behavioral  and  Social  Sciences  (ARI)  is  developing  and  evaluating  technology 
for  increasing  soldier  productivity.  The  ARI  Field  Unit  at  Fort  Knox, 
Kentucky,  in  its  work  unit  area  "individual  readiness  model  and  assessment" 
(Army  Project  2Q76271 7A767) ,  is  concerned  with  improving  the  methods  used 
to  assign  personnel  to  training  and  service  in  tank  crew  duty  positions. 

The  long-range  program  includes  developing  and  validating  predictor  tests 
to  improve  assignment  practices  and  lead  to  enchanced  tank  crew  combat 
proficiency. 

The  research  report  here  describes  the  development  and  initial  eval¬ 
uation  of  predictive  job  sample  tests  for  assigning  tank  crewmen  to  the 
position  of  gunner  based  on  objective  measures  of  their  aptitudes  and 
performance.  The  research  was  designed  in  response  to  requests  by  the  USA 
Armor  Center  (USAARMC)  and  the  USA  Armor  School  (USAARMS). 


JOpPH  l(^NER 
TeihnicalDi r ec  tor 
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JOB  SAMl’LF.J  AS  TANK  GUNNERY  PERFORMANCE  PREDICTORS 


BRIEF 


t  ’!i ;  PC  L  i  '.-fi ; 

Tr>  and  ovaUi;n.<?  Joh  snmpleR  as  predictors  of  tank  gunnery 

pert  orPMaco. 

r  e-.lu  r  (* : 

T'le  i:er>eai:c’r.  was  contluclieti  in  three  ptiases.  In  Phase  I,  three  job  sam- 

V.  I  f:  dovRi.rpc.i  and  evaluated.  These  tasks  represented  three  rajor 
!'ei|u  I  r  rnion  I's  oj'  lank  p.unnery  performance:  1)  the  rcrpi  irement  to  properly 
li.ick  a  taia.'  t,  ?)  tiie  r<'n,u.i  renient  to  sense  the  ‘'oc.ation  of  a  fired  round  with 
!  fa.-.'i' i  to  t'ne  larcft.  and  '>)  the  requiremenr  to  proper  Jy  adTrist  the  .second 
idiif..;  ,:,!:,„r  a  rirsi.  ri'und  mi:;.?,  hacli  of  these  reciu.iremeuts  v«s  te.sted  with  an 
.i;.,  o-opr  .i.i  t.  •- i;v,u  1  a  tor  ,  yielding  re.latively  objective  perli’rmaiice  mcasiires. 

!,e  V-  (cr  ii  o  as.  d  to  e.vaiiiate  the  proposed  nred.fcUH's  rensi.sfed  of  .a  modifier 
'  c'i  i.-  V .!  '  ..'r'  -rir,'  e.uToo'i.  V  e.xer'’.ise. 

11  r  (>r;ea  r<' ii  wn.s  dcaiKned  to  cninpicment  .rnrt  expand  npor.  Phase  .. 
i:  '.ae.u  ch,  u.iinf’  a  iai.ter  sar.ple.  In  riwsr  I,  tr.e  task  niea.sures  were  obtained 
freii  ce.se.ircli  pa  r  t  i<  i  pan  t  s  who  were  completing  training  as  tank  gunner/loaders. 
'  h'is  ii'p  r  e  I  a !.  1  lui  s !:  i  p.s  ohsei'vrvi  in  Phase  I  my  have  been  a  function  o:  the 
'  r.i  in  ;  ig  .'O' f  i  •.•ed  ,  r  t!uo-  tf.an  innate  abilities  or  aprittides.  ’''o  determine 
vnethf-T  the  rclat. ion.sV.ips  on‘"f'rved  in  Phase  I  were  a  function  of  achievement 
or  '10'  tndry  i.’/ia  :e  IT  re.si'ari  h  inrliidt'd  10  driver.s  who  bad  recently  c.ompa.eted. 
IMO;  1?F)  Jiiver  tv.ii'iing  .•’i  -ort  K.c.->x,  hut  liad  -.'.ct  hee.i  giver,  extensive  gur.~ 
n  -I  y  f  ra  in  i ng  . 

I'l  rha.so  IT',  the  cTiert  of  two  key  variaoies,  verbal  ieedback  and  level 
!  i'lM  If  t’ainip,:  op  jiii'  sar.ipie-Cank  gunnery  relat  ionship.s  were  evaluated. 

:i  aild  1 1  i  on ,  a  ne./  joh  sarajile,  conte.r-of-mas.s,  wn.'i  included  in  the  evaluation. 
Pi’se.'ircb  p.ir  t  i  c  i  pan  t  s  were  11  individuals  from  the  Reception  Station  at  Fort 
I';,  ',  .'vl  37  Liviividiials  in  tlieir  eighth  week  of  Basic  Armor  Training  (BAT  at 
I  O’  )  Knnx.  :vi !  rerrntc  t:cQrc.s,  a  reflection  of  the  amount  of  improvement  over 
(riali:  oil  Liie  job  sa'.i'ple  tasks  were  evaluated  as  predictors  of  live-fire  gun- 
rir.ry  p  -  rorpi.’’nce.  i’ii.:!.se  T.'I  j.  live-fJre  gunnery  prrfoniianee  was  scored  using 
sophisticated  video  playback  tecliniques. 


F  ind  ins-s : 

ibisse  [  vesullcd  in  identification  of  two  potentially  useful  joh  sample 
predictors.  The.se  wore,  diamond  tr.acklng  and  round  sensing.  Round  .adjustment 
wan  not  c.orre.Iated  with  gunnery  performance.  Pivisc  II  results  replicated  the 


V  i  i 

tHtouaxtt  Mfl* 


A 


Phase  I  relationships  of  diamond  tracking  and  round  sensing  to  tank  gunnery. 

In  Phase  III,  feedback  had  no  effect  on  job  sample-tank  gunnery  relationships. 
However,  level  of  prior  training  did  have  an  effect,  with  BAT  personnel  per¬ 
forming  at  a  higher  level  than  Reception  Station  personnel  on  most  job  sample 
tasks. 


Utilization  of  Findings: 

The  results  from  the  three  phases  of  research  suggest  that  job  samples 
seem  to  offer  promise  In  predicting  performance  after  formal  training  but 
prior  to  assignment  to  operational  units.  Future  research  efforts  may  be 
directed  toward  the  use  of  job  samples  as  performance  predictors  for  personnel 
within  operational  units.  Hands-on/j''b  sample  tasks  may  be  developed  which 
are  useful  in  the  selection  of  gunners  and  tank  commanders  to  fill  vacated 
slots  in  operational  units. 
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INTRODUCTION 


Prediction  of  tank  gunnery  performance  has  been  the  focus  of  several  re¬ 
cent  research  efforts  (Greensteln  and  Hughes,  1977;  Eaton,  Bessemer,  and  Kris¬ 
tiansen,  1979).  The  majority  of  this  research  has  utilized  paper-and-pencil 
aptitude/achievement  tests  as  predictors.  In  contrast,  Job  samples  —  '’hanas- 
on"  prediction  tests  which  comprise  aspects  of  the  required  task  considered 
crucial  to  successful  job  performance  —  have  seldom  been  measured. 

The  rationale  supporting  the  past  emphasis  on  paper-and-pencil  testing  is 
easily  understood.  These  tests  are  relatively  inexpensive  to  produce  and  ad¬ 
minister.  They  are  easily  scored,  easily  standardized  and  quite  portable.  On 
the  other  hand,  measurement  of  performance  on  job  samples  is  more  difficult. 

Job  samples  usually  require  the  development  and/or  purchase  of  equipment  on 
which  to  perform  and  instrumentation  for  measuring  that  performance.  Such 
equipment  and  instrumentation  is  frequently  neither  Inexpensive  nor  easily 
portable. 

Despite  the  research  emphasis  they  have  received  and  their  obvious  prac¬ 
tical  advantages,  paper-and-pencil  tests  have  had  only  moderate  success  as  pre¬ 
dictors  of  tank  gunnery  performance.  Test-performance  zero  order  correlation 
coefficients  greater  than  .35  are  rare.  Further,  multiple  regressions  of  test 
scores  on  gunnery  performance  Infrequently  exceed  .50,  Finally,  predictor- 
performance  relationships  seldom  cross-validate  to  new  samples  (Eaton,  1978; 
Eaton,  Bessemer,  and  Kristiansen,  1979). 

The  limited  research  in  which  job  samples  have  been  evaluated  have  yielded 
numerous  task-performance  relationships  in  the  range  of  .30  to  .40  (Eaton,  1978 
Gobel,  Baum,  and  Hagln,  1971).  These  results  provide  hope  for  improved  pre¬ 
diction  of  gunnery  performance.  For  example,  in  predicting  training  outcomes 
for  several  Air  Force  programs.  Hunter,  Maurelll,  and  Thompson  (1977)  demon¬ 
strated  that  job  sample  measures  did  yield  significant  Increments  over  tradi¬ 
tional  (AFOQT)  paper-and-pencil  tests.  Although  no  cross-validation  efforts 
have  been  undertaken  using  job  samples  in  the  tank  gunnery  context,  such  ef¬ 
forts  have  been  conducted  successfully  in  other  areas. 

Interest  in  job  sample  testing  has  gained  Impetus  from  the  notion  that 
paper-and-pencil  measures  reflect  variance  associated  with  cognitive  test¬ 
taking  skills  whereas  job  sample  measures  are  relatively  free  of  such  variance 
due  to  their  "hands-on"  nature.  In  addition.  Hunter  (1975)  has  concluded  that 
these  psychomotor  measures  are  less  susceptible  to  the  Influences  of  prior  edu¬ 
cational  and  cultural  differences  among  examinees.  Thus  an  individual  possess¬ 
ing  the  necessary  psychomotor  aptitudes  and  skills  for  successful  job  perfor¬ 
mance,  but  lacking  the  verbal  skills  or  education  to  perform  well  on  a  paper- 
and-pencil  test,  is  given  an  equal  opportunity.  These  facts  may  explain  to 
some  extent  the  Improvement  in  performance  prediction  obtained  with  job  samples 
For  these  reasons,  recent  research  efforts  directed  toward  the  prediction  of 
tank  gunnery  performance  have  emphasized  hands-on  performance  for  both  predic¬ 
tors  and  criteria  (Greensteln  and  Hughes,  1977;  Eaton,  1978;  Eaton,  et  al, 
1979). 


Another  advantage  of  job  samples  Is  their  face  validity  (Gordon  and 
Kleiraan,  1976).  By  selecting  an  actual  portion  of  the  task  as  the  pcrforrr.ance 
predictor,  many  of  the  situational  variables,  which  would  not  be  present  to  the 
same  degree  in  paper-and-pencll  tasks,  are  present  and  operating  In  the  job 
sample  tasks.  An  Indication  of  this  Is  the  Increased  level  of  motivation  ex¬ 
perienced  by  most  examinees  (Seegal  and  Bergman,  1975;  and  Gordon  and  Kleiman, 
1976).  Pruitt  (1970)  suggested  that  these  motivational  differences  may  be  due 
to  the  individual's  perception  that  he  or  she  is  actually  working  rather  than 
taking  a  test. 

Mlien  job  sample  and  paper-and-pencll  tests  were  compared  with  regard  to 
their  adverse  impact  on  examinee  attitudes,  "both  minority  and  majority  exam¬ 
inees  saw  the  job  sample  tests  as  significantly  fairer,  clearer,  and  more 
appropriate  in  difficulty  level"  (Schmidt,  Greenthal,  Hunter,  Berner,  and 
Seaton,  1977,  p.  187).  This  finding  coupled  with  the  finding  that  there  were 
no  significant  differences  between  minority  and  majority  attitudes  toward 
either  test  provides  support  for  expanding  research  in  the  area  of  job  sample 
performance  testing. 

In  summary,  the  advantages  accompanying  the  use  of  job  sample  tests  in¬ 
clude:  1)  reducing  response  bias  and  faking  compared  to  self  reports  of  atti¬ 
tudes,  beliefs  and  interests  (Wemimcnt  and  Campbell,  1968)  2)  minimizing  the 

disadvantages  for  individuals  who  have  limited  education  and/or  low  level  ver¬ 
bal  skills,  and  3)  providing  the  examinees  with  more  realistic  expectations 
about  the  job  (Pruitt,  1970;  O'I.eary,  1973;  and  Farr,  O'Leary  and  Bartlett, 
1973).  The  latter  of  these  advantages  is  of  significant  interest  in  light  of 
research  which  has  shown  that  realistic  Job  previews  can  decrease  the  likeli¬ 
hood  of  subsequent  voluntary  resignations  (Ilgen  and  Seeley,  1974). 

Due  to  the  limited  success  enjoyed  by  paper-and-pencll  tests  as  gunnery 
performance  predictors,  the  empirical  and  logical  support  for  considering  Job 
samples  as  performance  predictors,  and  the  continuing  need  of  the  Army  to  pre¬ 
dict  who  will  perform  well  in  tank  gunnery,  this  research  was  designed  to  ex¬ 
plore  the  potential  of  Job  samples  as  gunnery  predictors. 

In  Phase  I  a  variety  of  job  samples,  including  tracking,  sensing,  and 
round  adjustment  were  developed.  These  Job  samples  were  evaluated  as  potential 
predictors  with  recent  tank  gunner/loader  graduates  as  research  participants. 

In  Phase  II,  the  most  predictive  Job  samples  from  Phase  I  were  re-evaluated  to 
determine  whether  the  relationships  observed  in  the  first  phase  would  obtain 
with  a  second  sample  of  tank  gunner/loader  participants.  In  addition,  Phase  II 
job  sample  performance  was  evaluated  with  a  sample  of  research  participants 
who  were  relatively  unfamiliar  with  tank  gunnery  (tank  driver  trainees)  to 
determine  the  effect  of  gunner/loader  training  on  Job  sample  performance.  The 
information  obtained  was  used  to  evaluate  the  extent  to  which  Job  sample- 
gunnery  performance  relationships  might  be  related  to  aptitude  rather  than 
achievement.  In  Fliase  111,  issues  concerning  tine  of  Job  sample  test  adminis¬ 
tration  relative  to  stage  of  training  and  the  effects  of  external  feedback 
were  addressed.  Research  participants  included  gunncr/loader  trainees  tested 
in  either  feedback  or  no  feedback  situations  prior  to  training  and  after  eight 
weeks  of  training. 


PHASE  I 


In  this  phase  of  the  research,  three  Job  samples  were  chosen  for  evalua¬ 
tion.  These  represented  three  major  requirements  of  tank  gunnery  performance: 
1)  the  requirement  to  operate  tank  controls  in  order  to  properly  track  a  tar¬ 
get  (tracking),  2)  the  requirement  to  sense  the  location  of  a  fired  round  with 
respect  to  the  target  so  as  to  be  able  to  make  a  proper  adjustment  for  a  second 
round  (sensing),  and  3)  Che  requirement  to  change  the  point  of  aim,  based  on 
the  location  of  a  first  round  with  respect  to  the  target,  to  achieve  a  second 
round  hit  (round  adjustment).  Each  of  these  requirements  was  tested  with  an 
appropriate  simulator,  yielding  relatively  objective  performance  measures. 

It  was  hypotixeslzed  that  performance  on  the  three  Job  sample  tasks  would  be 
positively  related  to  tank  gunnery  performance  because  the  three  tasks  appeared 
to  have  a  high  degree  of  face  and  content  validity. 

METHOD 


SAMPLE 


Rese  irch  nart Ic tp  ints  were  47  g  'nner/ loaders.  They  were  recent  Armor  OSUT 
(MOS  I9E)  graduates  of  Ft  Knox  for  whom  tank  gunnery  scores  were  available  from 
ongoing  research  being  conducted  by  the  Army  Research  Institute  Field  Unit  at 
Ft  Knox.  Not  all  personnel  were  tested  on  all  tasks  due  to  time  constraints. 

Of  the  47  gunner/ loaders,  26  were  tested  on  the  tracking  task,  31  were  tested 
on  the  sensing  task,  and  16  were  tested  on  the  round  adjustment  task.  Of 
these,  10  men  participated  on  both  tracking  and  sensing,  10  participated  on 
both  tracking  and  round  adjustment,  15  participated  in  both  sensing  and  round 
adjustment,  and  nine  psrMclpnted  in  all  three  tasks. 

PROCEDURE  AND  VARIABLES 

Crewmen  participated  in  some  or  all  of  the  job  tasks  described  below. 

The  three  tasks  were  carried  out  in  separate  rooms,  and  scored  by  separate 
scorers. 

Tracking  Task.  In  the  tracking  task,  gunner /loaders  were  given  two  geo¬ 
metrical  designs,  a  circle  and  a  diamond  figure,  to  track  using  the  Willey 
Burst-on-Target  (BOT)  trainer.  The  Willey  BOT  Trainer  is  a  device  designed  to 
simulate  tank  gunnery  engagements.  The  equipment  basically  simulates  the  M60A1 
fire  control  system  and  includes  a  set  of  gunner's  hand  controls  which  modulate 
the  position  of  the  gunner's  sight  reticle  with  respect  to  the  target.  The 
actual  size  circle  and  diamond  designs  are  shown  in  Figures  1  and  2  respectively. 
Reduced-to-scale  inserts  are  also  provided  to  demonstrate  the  visual  field  of 
the  participant  at  the  onset  of  tracking. 

The  task  of  each  research  participant  was  to  track  between  the  lines  on 
each  circle  and  diamond  design  a  total  of  20  times.  Tracking  direction  (clock¬ 
wise/counterclockwise)  and  design  presentation  (clrcle/dlamond)  were  ■accom¬ 
plished  so  that  each  crewman  started  on  a  different  design  than  the  crewman 
preceding  him  and  research  participants  alternated  directions  of  tracking  for 
each  trial. 
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All  crewmen  received  two  scores  for  each  of  the  20  trials.  The  first 
score  was  a  time  score.  Three  scorers  manually  controlled  separate  1/100 
second  Hunter  timers.  These  timers  recorded  the  time  required  to  track  the 
entire  design.  The  research  participant's  score  was  the  mean  number  of  seconds 
appearing  on  the  three  clocks. 

The  second  tracking  score  was  an  error  score.  This  score  was  determined 
by  the  number  of  0.5  sec  periods  that  the  sight  reticle  (aiming  cross)  on  the 
Willey  EOT  trainer  was  either  In  contact  with  or  outside  the  border  line  of 
the  design.  Scorers  recorded  the  number  of  0.5  sec  pulses  emitted  by  a  Hunter 
timer  during  the  time  the  sight  reticle  was  not  between  the  border  lines  of 
the  design  for  each  trial.  The  research  participant's  score  for  each  trial 
was  determined  by  averaging  the  error  scores  obtained  from  the  three  scorers. 

Error  and  time  scores  for  both  diamond  and  circle  were  the  means  from  the 
three  scorers  over  trial  16-20  (the  last  five  trials)  for  each  crewman.  Trials 
16-20  were  chosen  because  the  asymptotic  performance  level  was  approached  by 
trial  15,  for  both  time  and  error. 

Sensing  Task.  On  the  sensing  task,  31  gunner/loaders  reported  their 
sensing  of  a  total  of  25  simulated  main  gun  rounds.  Five  Ektachrome  slides, 
each  representing  a  different  portion  of  a  Table  VI-M  tank  gunnery  range  at 
Ft  Knox,  Kentucky,  were  used  to  present  targets  for  this  task.  Each  crewman 
was  required  to  sense  the  location  of  five  simulated  rounds  "fired"  at  each  of 
the  five  target  slides.  A  typical  slide  is  illustrated  in  Figure  3. 

The  "firing"  simulation  was  accomplished  by  employing  an  ICONIX  6246 
Tachlstoscope  (T-scope),  two  Kodak  Carousel  slide  projectors,  and  a  50"  X  36" 
screen.  Each  target  slide  was  projected  on  the  screen  for  the  duratior.'  of 
a  five-round  simulated  engagement.  A  second  slide  projector,  controlled  by 
the  T-scope,  presented  a  small  red  blip  which  was  superimposed  on  the  target 
projection  slide  for  a  period  of  10  msec.  The  blip,  simulating  a  main  gun 
round,  was  produced  by  placing  a  red  acetate  film  over  a  pinpoint  hole  made  in 
a  separate  opaque  slide. 

The  experimenter  began  the  presentation  for  each  of  the  25  simulated 
rounds  by  announcing  "on  the  way"  and  manually  engaging  the  T-scope  controlled 
sequence.  After  the  presentation  of  each  simulated  round,  the  research  par¬ 
ticipant  recorded  his  sensing  of  the  round  on  a  score  sheet  which  consisted  of 
a  hand-drawn  replication  of  the  Table  Vl-M  target  slide  just  presented.  The 
participant  received  a  new  score  sheet  representing  the  new  target  slide  prior 
to  each  five  round  engagement. 
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The  deviation  In  millimeters  of  the  sensed  round  from  its  true  location 
was  computed.  These  deviations  were  measured  by  placing  a  Xerographic  trans¬ 
parency  on  which  the  true  location  of  the  simulated  main  gun  rounds  had  pre¬ 
viously  been  plotted  over  the  participant's  score  sheet.  The  sensing  score 
consisted  of  the  mean  deviation  for  the  25  trials. 


Round  Adjustment  Task,  The  Fire  Control  Combat  Simulator  (FCCS)  was  used 
to  measure  the  participant's  round  adjustment  performance.  The  FCCS  Is  a  de¬ 
vice  designed  to  simulate  tank  gunnery  engagements.  The  configuration  and 
computer  program  simulated  the  M60A1  fire  control  system  during  conventional 
firing  engagements.  The  FCCS  contained  an  Instructor's  console  and  a  gunner's 
station.  From  the  Instructor’s  console,  a  variety  of  situations  could  be  pro¬ 
grammed  which  specified  target,  terrain,  and  type  of  round,  and  required  the 
gunner's  assessment  and  response. 

The  task  utilizing  the  FCCS  tested  crewmen  on  their  ability  to  apply 
standard  burst-on-target  (BOT)  procedures  while  tracking  a  moving  target.  BOT 
is  a  technique  of  fire  adjustment  employed  when  a  first  round  miss  occurs. 

The  program  of  Instruction  at  Ft  Knox  Indicated  that  all  gunners  were  trained 
to  note  the  position  of  the  miss  relative  to  the  sight  reticle  and  place  that 
portion  of  the  sight  reticle  on  the  center  of  mass  of  the  target. 

By  programming  the  FCCS  in  a  particular  sequence  (see  Appendix  A),  the 
gunner  was  forced  to  miss  the  first  round.  Each  creimtan  was  given  six  one- 
round  practice  engagements  for  familiarization  with  the  apparatus.  The  prac¬ 
tice  engagements  were  not  scored.  At  the  conclusion  of  the  practice,  each 
crewman  was  given  12  two-round  engagements  that  were  scored.  Scores  for  the 
crewmen  were  the  number  of  targets  "hit"  on  the  second  round  of  the  12  two- 
round  engagements.  The  first  round  of  each  engagement  was  Ignored  because  the 
first  round  was  programmed  to  miss. 

Tank  Gunnery  Scores;  Table  VI-M.  Steel's  Main  Gun  Tank  Range  at  Ft  Knox, 
Kentucky  was  used  for  the  Table  Vl-M.  Normal  range  operation  procedures  were 
utilized,  but  major  changes  were  made  In  the  targets,  the  engagements,  and  the 
method  of  scoring. 

The  standard  cloth  panel  stationary  targets  were  replaced  by  1.8m  x  1.8m 
stationary  plywood  targets.  These  targets  were  placed  at  ranges  of  1000m  and 
1400m.  The  moving  target  was  a  6.5m  plywood  flank  tank  target  at  a  distance 
of  700m,  traveling  approximately  5  km/h  and  perpendicular  to  the  line  of  fire. 
Standard  zero  panels  placed  at  1200m  were  also  used. 

Each  crewman  was  required  to  fire  a  warm-up  round  at  the  zero  panel,  one 
two-round  engagement  at  both  the  1000m  and  1400m  targets,  and  two  two-round  en¬ 
gagements  at  the  moving  target.  The  order  of  fire  and  engagement  techniques 
are  shown  In  Appendix  B. 

Scoring  was  achieved  by  two  scorers  observing  each  firing  tank.  One 
scorer  used  a  periscope,  BC  M65,  lOx,  while  the  other  used  a  pair  of  8x  binocu¬ 
lars.  Scorers  also  maintained  constant  voice  contact  with  the  firing  tank 
through  the  use  of  the  external  Intercom  located  at  the  rear  of  the  M60A1  tank. 
Thus  the  scorers  knew  when  the  gunner  would  fire  each  round,  and  the  specific 
target  at  which,  he  was  to  fire.  Scores  were  recorded  as  a  hit  or  miss,  based 
on  a  consensus  between  the  two  scorers. 


Each  rcsearc.li  parclcrpant  was  required  to  do  his  own  sensing,  fire  ad¬ 
justment  and  firing.  The  function  of  the  Tank  Commander  (TC)  was  to  ensure 
that  correct  safety  measures  were  followed,  to  determine  the  range  to  the  tar¬ 
get,  to  lay  the  gun  tube,  in  the  general  area  of  the  target,  and  to  give  the 
fire  command. 

DATA  HANDLING 

Scores  for  time  and  error  for  both  circle  and  diamond  tracking  were  raw 
scores.  In  addition,  combined  scores  for  circle  and  diamond  tracking  were  com¬ 
puted  by  converting  each  crewman’s  time  and  error  scores  (for  each  design 
separately)  to  ^  scores  and  adding  the  two  scores  together. 

Scores  on  the  sensing  and  round  adjustment  tasks  were  raw  scores.  On  the 
sensing  task,  lost  rounds  or  rounds  sensed  25mni  or  more  from  their  true  loca¬ 
tion  were  scored  as  25imu  errors. 

Tank  gunnery  (Table  VI-M)  performance  measures  were  number  of  moving  tar¬ 
get  hits,  number  of  first  round  hits,  and  number  of  second  round  hits.  Table 
VI-M  overall  scores  were  computed  by  multiplying  the  number  of  first  round 
hits  by  10  and  adding  l.h.nt  product  to  the  number  of  .second  round  hits  multi¬ 
plied  live. 


RESUL'^S 


T.RACKING-TANK  GUNNERY  RllLATIONSHIPS 

Correlations  were  computed  between  each  of  the  tracking  task  measures 
(time,  error,  and  combined  scores,  for  both  circle  and  diamond  figures)  and 
each  of  the  tank  gunnery  measures  (overall  scores,  moving  target  hits,  first 
round  hits  and  second  round  hits).  Although  there  were  no  significant  rela¬ 
tionships  between  circle  tracking  and  tank  gunnery  performance,  significant 
relationships  were  ob.served  between  diamond  tracking  and  gunnery  performance. 
Crewmen  with  fewer  diamond  errors  had  higher  overall  scores  (r  ■  -.41,  2.  <*05), 
and  more  first  round  target  hits  (r  *  -.50,  2  A  complete  intercorrela- 

tion  matrix  is  provided  in  Appendix  C. 

SENSING- TANK  GUNNERY  RELATIONSHIPS 

Correlations  were  computed  between  participants'  sensing  scores  and  their 
gunnery  measures  (overall  score,  moving  target  hits,  first  round  and  second 
round  hits).  The  relationship  between  sensing  and  both  second  round  hits  and 
overall  scores  approached  significance  (t  ”  -.35  and  -.34,  2  -*05  and  .06, 
respectively) .  It  is  Interesting  to  note  that  although  relationships  with  the 
cracking  task  were  statistically  significant,  and  those  with  the  sensing  task 
approached  significance,  the  sensing  and  tracking  tasks  were  not  significantly 
correlated  with  one  another  (see  Appendix  C). 


ROUND  ADJUSTMENT-TANK  GUNNERY  RELATIONSHIPS 


Analysis  of  the  FCCS  data  and  tank  gunnery  scores  revealed  no  significant 
relationships.  The  ability  to  apply  BOT  procedures  and  hit  a  moving  target  or. 
the  FCCS  device  was  an  s  .gnif  icantly  related  to  the  gunner's  cv.  rall 
first  and  second  round  hits  nor  to  the  number  of  moving  target  hits  (sec 
Appendix  C). 

INTER-SCORER  RELIABILITY  ON  TRACKING  ERROR 

Because  the  tracking  error  measure  was  based  on  the  visual  evaluation  of 
research  partlclpanc  performance,  the  reliahility  of  the  tracking  error  could 
be  questioned.  Inter-scorer  reliabilities  were  determined.  The  three  scorers 
used  in  the  cracking  task  provided  high  scorer  reliability  coefficients  for 
diamond  error  and  moderate  reliability  for  circle  error.  For  the  diamond  error 
measure,  correlations  were  .91,  .94,  and  .52  for  scorers  1  and  2,  1  and  3,  and 
2  and  3,  respectively.  For  the  circle  error  measure,  correlations  were  .63, 
.56,  and  .35  for  scorers  1  and  2,  1  and  3,  and  2  and  3,  respectively. 


DISCUSSION 


The  puipvKse  fsi  chrs  research  was  lo  evaluate  the  relationship  between 
performance  on  several  job  samples  and  tank  gunnery  performance.  The  results 
of  tha  research  revealed  significant  relationships  between  gunnery  performance 
and  both  round  sensing  and  tracking  of  t'l.e  diamond  figure.  The  fewer  errors 
research  participants  made  in  sensing  and  fracking,  the  better  they  performed 
In  tank  gunnery. 

The  relationship  between  round  sensing  and  measures  of  gunnery  perfor¬ 
mance  were  readily  interpretable.  Round  sensing  had  a  numerically  higher  cor¬ 
relation  with  second  round  hits  than  with  first  round  hits.  Such  a  relation¬ 
ship  was  expected  because  applying  BOT  procedures  involved  knowing  generally 
where  the  round  landed  with  respect  to  the  target  (i.e.,  round  sensing)  and 
specifically  where  the  sight  reticle  was  placed  with  respect  to  the  target 
picture.  This  provided  the  gunner  with  specific  information  on  second  round 
engagements,  but  only  general  information  on  first  rounds  of  later  engagements. 

Relationships  involving  diamond  tracking  error  were  not  so  easily  inter¬ 
preted.  The  tracking  task  was  designed  to  measure  a  participant's  ability  to 
operate  the  turret/gun  controls.  While  such  ability  should  have  beer  generally 
related  to  performance  on  all  engagements,  it  should  have  been  most  strongly 
related  to  moving  target  hits.  However,  that  was  not  the  case.  Diamond  track¬ 
ing  was  significantly  related  only  to  first  round  hits,  and  overall  score. 
Interestingly,  the  error,  rather  than  the  overall  time  measure,  accounted  for 
these  relationships.  Thus,  it  was  not  a  gunner's  overall  speed  on  the  tracking 
task,  but  Instead  his  accuracy,  that  accotinted  for  the  variance  in  the  gunnery 
performance. 

Tracking  the  circle  figure  was  much  more  difficult  than  the  diamond.  The 
circle  required  constant  changes  in  horizontal  and  vertical  movement  (or 
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traverse  and  elevation),  as  opposed  to  the  fixed  degree  of  norizontal  and  ver¬ 
tical  movement  with  changes  only  ^t  corners  required  to  track  the  diamond. 
However,  the  gunners  in  this  research,  were  not  required  to  perform  such  com¬ 
plex  tracking  on  Table  VI-M,  The  moving  target  traveled  slowly  across  the  range 
in  a  constant  direction.  This  difference  may  have  accounted  for  the  failure 
to  observe  a  relationship  between  circle  tracking  and  moving  target  hits. 

Circle  tracking  may  serve  as  a  predictor  of  gunnery  performance  with  evasive 
targets  moving  in  complex  patterns  (see  Jones  and  Jehan,  1978,  for  further  dis¬ 
cussion  on  this  topic). 

No  clear  rationale  exists  for  the  failure  to  observe  predictor-criterion 
relationships  between  the  circle  tracking  and  overall  gunnery  performance.  One 
explanation  proposed  that  the  lower  scorer  reliability  for  the  circle  error  may 
i.ave  contributed  to  the  lack  of  significant  correlations. 

The  failure  to  observe  relationships  between  the  round  adjustment  measure 
and  gunnery  performance  was  also  not  easily  Interpreted.  The  round  adjustment 
measure  should  have  evaluated  both  tracking  and  EOT  ability.  Yet  despite  the 
high  fidelity  of  the  FCCS  controls,  and  Che  objective  measurement  potential  it 
offered,  no  significant  results  with  gunnery  were  obtained.  In  fact,  the  high¬ 
est  correlation,  a  -.21,  was  in  the  wrong  direction,  i.e.,  the  more  targets  hit 
on  the  Fees,  the  fewer  second  round  hits  on  Table  VI-M.  Apparently  high-fidelity 
and  sophisticated  stimulus  control  and  response  miiasurement  in  a  simulator  are 
no  guarantee  of  significant  relationships  with  on  the  job  performance. 
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PHASE  II 


Phase  II  of  this  research  was  designed  to  complenent,  and  expand  upon,  thi 
Phase  I  research.  Overall,  the  results  of  Phase  I  research  were  favorable,  anti 
two  Job  sample  measures  were  related  to  gunnery  perforaance  (diamond  error  and 
sensing  error).  Several  Issues  however,  were  not  completely  addressed. 

First,  because  a  small  number  of  participants  performed  all  tasks,  the 
intercorrelations  between  tasks  provided  in  Appendix  C  can  only  be  considered 
as  crude  estimates  of  population  parameters.  These  intercorrelations  should  be 
explored  more  fully  to  determine  the  degree  to  which  task  performance  accounts 
for  unique  gunnery  variance.  Tasks  related  to  gunnery  performance,  but  unre¬ 
lated  to  one  another,  account  for  unique  gunnery  variance,  and  thus  may  be  com¬ 
bined  for  improved  gunnery  prediction.  Those  tasks  which  are  highly  inter- 
correlated,  on  the  other  hand,  are  redundant,  that  is,  a  second  measure  adds 
little  to  prediction,  once  the  first  measure  is  known. 

In  addition,  during  the  first  phase  of  the  research,  many  different 
measures  of  the  job  sample  tasks  were  obtained,  and  many  measures  of  Table  VI-K 
were  evaluated,  but  the  sample  size  was  relatively  small.  Consequently,  there 
was  liberal  opportunity  for  Type  II  errors  in  evaluating  relationships  between 
task  measures  and  gunnery  performance.  Those  tasks  which  did  show  apparently 
significant  relationships  with  gunnery  performance  (tracking  and  sensing) 
needed  to  be  re-evaluated  to  determine  whether  the  task-gunnery  relationships 
obser'^ed  in  Phase  I  i^ere  attributable  to  chance. 

Finally,  the  task  measures  in  Phase  I  were  obtained  from  research  partici¬ 
pants  who  were  completing  training  as  tank  gunner/loaders.  Thus,  the  relation¬ 
ships  observed  may  hjjve  been  due  to  achievement  rather  than  aptitude.  Partici¬ 
pants  who  received  m<  re  help  in  training,  had  prior  experience  or  worked  harder, 
could  have  learned  tc  be  better  gunner/loaders,  and  consequently  performed 
better  on  both  tank  gunnery  and  the  job  sample  tasks. 

Such  a  hypothesis  implies  that  for  some  of  the  gunner/loader  participants 
at  least,  training,  aptitude,  and/or  motivation  resulted  in  some  level  of 
achievement,  and  that  the  achievement  was  reflected  by  task  performance.  Con¬ 
sequently,  this  hypothesis  can  be  evaluated  by  comparison  of  task  performance 
of  gunner/loader  trainees,  and  other  participants  who  are  comparable  In  many 
ways,  but  are  relatively  untrained  in  gunnery. 

The  purpose  of  the  Phase  II  research  was  to  address  these  Issues  by  pro¬ 
viding  more  stable  measures  of  task  Intercorrelations,  re-evaluating  and  vali¬ 
dating  the  significant  task-performance  relationships  observed  in  Phase  I,  and 
determining  whether  task-performance  relationships  are  more  likely  due  to 
achievement  or  aptitude  measurement. 


METHOD 


SAMPLE 

Research  participants  Included  2 A  gxinner/ loaders  who  recently  graduated 
from  Armor  OSUT  (MOS  19E)  at  Ft  Knox  and  for  whom  tank  gunnery  Table  VI-M 
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scores  were  available.  In  addition,  the  sample  Included  10  drivers  who  re¬ 
cently  completed  Armor  OSUT  (MOS  19F)  at  Ft  Knox.  Unlike  gunner/loaders, 
drivers  are  not  given  extensive  gtinnery  training,  and  do  not  fire  on  main  gun 
tank  ranges  at  Ft  Knox. 

PROCEDURE 

Tracking  Task.  As  In  Phase  I,  crewmen  were. given  the  circle  and  diamond 
designs  to  track  on  the  Willey  device.  Each  crewman  was  required  to  track  both 
designs  20  times  as  in  Phase  I.  Diamond  and  circle  error  scoring  was  accom¬ 
plished  the  same  way  with  the  exception  that  only  one  scorer  was  used. 

Sensing  Task.  The  methods  for  the  sensing  task  were  the  same  as  in  Phase  I 
with  the  exception  that  half-tone  prints  were  used  In  place  of  the  standard 
hand-drawn  score  sheets  and  lost  rounds  or  rounds  sensed  lOmm  or  more  from  their 
true  location  were  scored  as  10mm  errors.  The  half-tone  prints  were  copied  from 
the  pictures  of  the  Table  VI-M  course  that  were  used  for  the  target  slides. 

Round  Adjustment  Task.  The  round  adjustment  task  was  eliminated  because 
no  significant  relationships  with  Table  VI-M  performance  were  observed  in 
Phase  I . 

Table  VI  Modified.  The  Table  VI-M  firing  range  procedures  and  method  of 
scoring  were  identical  for  Phases  I  and  II.  Table  VI-M  was  fired  by  gunner/ 
loaders  only.  Drivers  did  not  fire  Table  VI-M  as  it  was  not  part  of  their 
normal  training,  and  not  necessary  for  the  research. 

RESULTS 


TANK  GUNNERY  RELATIONSHIPS 

Tracking;  Tank  Gunnery  Relationships.  Correlations  were  computed  between 
each  of  the  tracking  task  measures  and  the  tank  gunnery  measures.  As  in  Phase  I 
there  were  no  significant  relationships  between  circle  tracking  and  tank  gunnery 
performance,  but  significant  relationships  did  exist  between  diamond  tracking 
and  tank  gunnery  performance.  Gunner /loaders  with  fewer  diamond  errors  had 
higher  overall  gunnery  scores  (r  ■  -.49,  2.  ^*02),  more  moving  target  hits 
(r  ■  -•41,  <.05),  more  first  round  hits  (r  =  -.43,  £_  <.05)  and  more  second 

round  hits  (r  ■  -.46,  £  <.05).  A  complete  intercorrelation  matrix  Is  provided 
in  Appendix  D. 

It  is  Interesting  to  note  that  In  Phase  II  crewmen  tended  to  take  longer 
In  the  tracking  task  and  to  make  more  errors  than  the  crewmen  In  Phase  I. 

Because  both  samples  were  drawn  from  the  same  population,  there  Is  some  reason 
to  believe  that  the  higher  error  scores  In  Phase  II  were  the  result  of  scorer 
learning.  The  scorer  In  the  tracking  task  probably  became  more  skilled  or  pro¬ 
ficient  In  the  task  of  scoring.  This  result  would  Indicate  a  need  to  refine 
the  scoring  technique  and  Instrument  the  scoring  phase  whenever  possible  to 
control  this  scorer  influence. 
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Sensing;  Tank  Gunnery  Relationships.  Correlations  were  corapuceci  between 
the  sensing  score  and  the  tank  gunnery  measures.  A  significant  relationship 
was  observed  between  number  of  errors  on  the  sensing  task  and  tank  gunnery  per¬ 
formance.  As  can  be  observed  in  Appendix  D,  crewmen  with  fewer  sensing  errors 
had  higher  overall  scores  (r  ■  -.41,  <.05).  No  significant  relationships 

were  observed  between  sensing  score  and  the  moving  target,  first  round  hits,  or 
second  round  hits,  although  the  correlations  with  moving  targets  and  second 
round  hits  approached  significance  (r's  =»  -.36  and  -.35,  2.  <•10).  It  is  also 
worthy  to  note  that  the  correlation  between  diamond  error  and  sensing  error  was 
again  nonsignificant  (and  in  this  case,  zero). 

Tracking  and  Sensing  Combined;  Tank  Gunnery  Relationships.  Phase  I  re¬ 
search  suggested  the  utility  of  both  diamond  error  and  sensing  error  as  pre¬ 
dictors  of  Table  VI-M  scores  and  indicated  their  intercorrelation  was  about 
zero.  Therefore,  both  error  scores  for  Phase  II  subjects  were  combined  as 
predictors  of  Table  VI-M  according  to  the  unit -weighted  model  (as  suggested  by 
Einhorn  and  Hogarth,  1975;  Schmidt,  1971;  and  Lawshe  and  Schucker,  1959). 
Unit-weighted  models  have  been  suggested  for  small  sample  research  because  only 
the  direction  of  the  predictor-criterion  relationship  needs  to  be  known.  Beta 
weights  are  not  computed,  but  instead  are  set  arbitrarily  at  one.  While  there 
is  somewhat  less  precision  with  this  approach,  there  is  also  less  opportunity 
for  error  in  Incorrect  Beta-weight  estimation. 

In  applying  the  unit-weighted  model  to  the  data,  standardized  scores  were 
computed  for  tracking  error,  sensing  error,  and  Table  VI-M  overall  scores. 
Standardized  error  scores  were  then  added  together,  and  their  sum  correlated 
with  standardized  Table  VI-M  scores,  yielding  an  r  =  .64,  £  <.01  (the  signs  for 
the  error  score  were  reversed  to  achieve  a  positive-going  scale).  Thus,  the 
fewer  errors  a  participant  made  in  tracking  and  sensing  the  higher  his  predicted 
Table  VI-M  score,  and  the  better  his  actual  Table  VI-M  score.  This  relationship 
is  shown  in  Figure  4. 

In  addition  to  computations  with  the  unit  weight  model,  standard  multiple 
regression  cross-validation  techniques  were  employed.  Beta  weights  for  track¬ 
ing  and  sensing  error  measures  were  computed  from  Phase  I  data  and  applied  to 
standardized  error  scores  in  Phase  II,  yielding  an  R  =  .65,  p  <.01.  The  high 
similarity  between  unit  model  and  multiple  regression  model  results  was  due  to 
the  ratio  of  the  computed  Beta  weights  (B^  =  -.64,  B2  =  -.59).  Their  ratio  was 
.92,  nearly  1.00.  Consequently,  in  this  case  unit-weight  and  multiple  regres¬ 
sion  models  provided  nearly  the  same  result.  The  plot  of  multiple  regression 
predicted  to  actual  Table  VI-M  scores  was  almost  identical  to  Figure  4. 

Comparisons  Between  Gunner  and  Driver  Performance.  To  evaluate  the  extent 
to  which  gunner's  performance  on  the  tracking  and  sensing  tasks  was  a  function 
of  their  prior  gunnery  training  (i.e.,  achievement)  in  19E  Armor  OSUT,  compar¬ 
isons  of  gunner's  and  driver's  scores  were  made  by  using  £-tests.  Means, 
standard  deviations,  t;-test  results,  and  sample  size  are  shown  in  Table  1  for 
drivers  and  gunners  on  each  task.  No  significant  differences  between  gunners 
and  drivers  were  observed  on  any  of  the  tasks.  In  the  one  instance  where  the 
comparison  did  suggest  a  difference  between  gunner  and  driver  performance, 
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Combined  Standardized  Diamond  Tracking  and  Sensing  Errors 


Figure  4.  Prediction  of  Gunnery  Performance  from  Combined  Standardized  Diimond 
Tracking  and  Sensing  Errors  Based  on  Unit  Weight  Model 
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Table  1 


GUNNER  AND  DRIVER  COMPARISONS 


Gunner 

Mean 

(N  -  24) 
Standard 
Deviation 

Driver 

Mean 

(N  -  10) 
Standard 
Deviation 

t* 

Diamond  Error 

10.43 

4.70 

10.48 

7.53 

.02 

Diamond  Time 

17.87 

5.50 

18.14 

4.37 

.12 

Circle  Error 

14.01 

6.07 

16.44 

2.37 

-1.04 

Circle  Time 

20.82 

7.02 

19.17 

5.17 

-.57 

Sensing  Error 

39.88 

11.77 

28.96 

18.61 

-1.77 

*all  g^>  .05 
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sensing  error,  ®  -i.77)  drivers  yielded  less  error  urtan  gunuers.  This  re¬ 
sult  Is  contrary  to  the  direction  hypothesized  had  the  job  sample-gunnery  per¬ 
formance  relationships  been  based  on  achievement. 

DISCUSSION 

The  purpose  of  this  phase  of  the  research  was  to  confirm  and  extend  the 
findings  of  Phase  1.  The  results  confirmed  both  of  the  significant  relation¬ 
ships  between  Table  VI-M  scores  and  diamond  and  sensing  error.  In  addition, 
both  a  unit-weighted  model  and  a  standard  multiple  regression  model,  based  on 
results  from  Phase  1,  provided  a  very  good  fit  between  Phase  II  diamond  and 
sensing  measures  and  Table  VI-M  performance.  Approximately  35%  of  the  variance 
on  Table  VI-M  was  accounted  for  by  those  two  variables.  The  magnitude  of  this 
relationship  was  due  to  the  fact  that  the  two  error  measures  proved  to  be  un¬ 
correlated,  and  thereby  provided  unique  contributions  to  predictions  of  gun¬ 
ner's  scores.  In  addition,  the  relationships  between  gunnery  and  job  sample 
scores  seem  to  be  more  likely  due  to  aptitude  rather  than  achievement  measure¬ 
ment.  This  Is  because  gunner/loaders,  who  had  considerable  gunnery  training, 
scored  no  better  on  the  job  sample  tasks  than  drivers,  who  had  relatively 
little  gunnery  training. 

Overall,  It  appears  that  the  development  and  empirical  validation  of  an 
appropriate  set  of  job  samples  gives  promise  of  measures  yielding  reasonably 
large  correlations  with  gunnery  performance.  Moreover,  such  relationships  may 
be  attributed,  in  large  part,  to  aptitude  rather  than  achievement  measurement. 
Consequently,  such  techniques  seem  to  have  reasonable  potential  for  use  in 
assignment  of  personnel  to  appropriate  training  programs. 
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PHASE  III 


Phase  III  of  this  research  was  conducted  to  further  evaluate  the  use  of 
Job  samples  In  predicting  criterion  performance.  The  results  of  the  vo  pre¬ 
vious  phases  prompted  Interest  in  the  effects  of  two  key  variables,  \ cr’-al 
feedback  and  level  of  training  on  the  previously  Identified  predictor /■’rfor- 
mance  relationships. 

Feedback  has  been  shown  to  enhance  learning.  This  effect  has  been  demon¬ 
strated  for  individuals  (Stockbrldge  and  Chambers,  1958)  and  groups  (Alexander 
Kepner,  and  Tregoe,  1962)  in  military  settings.  Holding  (1965)  described  a 
useful  system  for  classifying  information  feedback  (IF)  or  knowledge  of  results. 
Major  dichotomies  in  this  system  include:  1)  intrinsic  (present  in  the  standard 
task)  versus  artificial  (added  to  the  standard),  2)  concurrent  (during  response) 
versus  terminal  (after  response) ,  and  3)  separate  (for  each  response)  versus 
accumulated  (for  several  responses) .  This  system  provides  a  useful  framework 
in  which  to  discuss  the  effects  of  varying  the  kind  and  the  amount  of  feedback, 
both  of  which  have  been  shown  to  affect  performance  (Goldstein  and  Ritten- 
house,  1954) , 

A  specific  amount  of  feedback  is  intrinsic  to  both  the  job  sample  testing 
and  the  gunnery  criterion  performance  situations.  VJith  regard  to  job  sample 
testing,  it  was  not  known  whether  providing  feedback  enhanced  or  degraded  per¬ 
formance  on  job  sample  tests.  In  addition,  the  effect  of  feedback  on  predictor/ 
performance  relationships  had  not  been  determined - 

In  the  two  previous  phases,  job  samples  were  measured  after  formal  armor 
training.  Reasonably  large  correlations  with  subsequent  gunnery  performance 
were  obtained.  The  question  existed  as  to  whether  these  correlations  would 
obtain  when  job  sample  measurement  took  place  before  training,  or  after  basic 
training,  but  before  intensive  gunner/loader  training. 

In  addition  to  evaluating  the  effects  of  feedback  and  level  of  training, 
a  new  job  sample  task  was  Included  in  Pliasc  III.  Center-of-raass  determination 
represented  a  major  component  of  tank  gunnery  performance  wliich  included  the 
requirement  to  traverse  the  turret  and  lay  the  main  gun  quickly  and  accurately 
on  the  preferred  portion  of  the  target. 

Finally,  job  snmplcB  as  predictors  of  tank  gunnery  porformanca  had  not 
previously  been  compared  to  current  ASVAl)  based  papGr-.and-pencil  predictors. 

This  required  obtaining  job  samples,  ASVAH,  and  gunnery  pcrform.mce  data  for 
a  large  sample  of  research  participants. 

METHOD 


SAMPLE 

The  research  participants  were  randomly  selected  from  the  population  of 
trainees  assigned  to  gunner/loader  (MOS  19E)  training  at  Ft  Knox.  Job  sample 
teata  wara  administered  to  160  men  representing  10  separate  companies.  Mot 


all  personnel  were  tested  on  all  tasks  due  to  time  constraints  and  all  the  men 
from  one  company  were  eliminated  from  the  data  analysis  due  to  equipment  per¬ 
formance  failure  beyond  the  control  of  the  experimenter.  Of  the  remaining  144 
participants,  complete  data  seta  were  available  for  63  or  88,  depending  upon 
the  analysis  required. 

PROCEDURE 

Sixteen  (16)  men  per  company  from  10  companies  were  tested.  Eight  of  the 
16  men  from  each  company  were  tested  during  the  time  they  were  in  the  Ft  Knox 
Reception  Station.  The  remaining  eight  were  tested  after  they  had  completed 
approximately  eight  weeks  of  Basic  Armor  Training  (BAT) .  Of  the  eight  persons 
in  each  of  these  groups,  four  received  verbal  feedback  (knowledge  of  results) 
during  the  job  sample  testing,  while  the  remaining  four  received  no  verbal  in¬ 
formation  concerning  their  performance.  Each  participant  was  tested  on  three 
separate  job  sample  tasks:  1)  tracking,  2)  sensing,  and  3)  center-of-mass. 

Tracking  Task.  Crewmen  were  asked  to  track  the  diamond  design  using  the 
Willey  BOT  trainer.  After  receiving  appropriate  Instructions,  (see  Appendix  E'^ 
each  crewman  was  allowed  to  practice  tracking  the  design  once  clockwise  and 
once  counterclockwise.  Upon  completion  of  the  practice  trials,  each  crewman 
tracked  the  design  20  times,  alternating  direction  at  the  beginning  of  each 
trial.  Crewmen  in  the  feedback  group  were  provided  with  scores  reflecting  the 
time  it  took  them  to  track  the  design  and  the  number  of  errors  committed  after 
each  trial.  Crewmen  in  the  no  feedback  group  were  not  provided  information 
concerning  their  performance. 

The  time  score  consisted  of  the  total  elapsed  time  from  the  "go"  command 
to  the  "stop"  command  on  each  trial.  This  score  was  the  time  appearing  on  a 
standard  1/100  second  Hunter  timer  which  was  manually  controlled  by  the  scorer. 
The  total  number  of  errors  per  trial  was  computed  by  counting  the  number  of 
0.5  sec  pulses  emitted  by  another  Hunter  timer  during  the  time  in  which  the 
aiming  cross  portion  of  the  sight  reticle  was  not  between  the  borders  of  the 
diamond  design.  Scorers  viewed  the  design  by  means  of  a  video  monitor  placed 
on  a  table  behind  the  subject.  For  convenience  the  pulses  from  the  second 
Hunter  timer  were  recorded  on  cassette  tape  and  played  through  headphones  worn 
by  the  scorer,  thereby  minimizing  subject  distraction.  The  tracking  trials 
were  videotaped  for  later  error  score  verification. 

Sensing  Task.  The  methods  for  the  sensing  task  were  the  same  as  in  Phase 
II  with  the  exception  that  crewmen  in  the  feedback  group  were  told  their  mean 
deviation  for  the  five  rounds  in  each  engagement  prior  to  the  presentation  of 
the  next  target  slide  (see  Appendix  F) .  In  the  no  feedback  group,  no  informa¬ 
tion  was  provided  concerning  performance. 

Center-of-Mass  Task.  This  task  was  presented  immediately  following  com¬ 
pletion  of  the  tracking  task  and  was  videotaped  in  its  entirety.  A  slide  pre¬ 
senting  four  tanks  was  placed  In  the  Willey  BOT.  The  crewman  was  instructed 
te  move  the  aiming  cross  from  the  center  position  (see  Figure  5)  to  the  desig¬ 
nated  target  on  the  conmand  "go"  (see  Appendix  G).  The  crewman  fired  the 
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Willey  laser  when  he  determined  that  the  aiming  cross  was  on  the  center-of-mass 
of  the  target.  Each  participant  completed  eight  trials^  two  trials  per  target. 


Scoring  was  accomplished  by  means  of  a  manually  controlled  Hunter  stop- 
clock  to  determine  total  time  for  each  trial  from  the  "go"  command  until  firing. 

A  1.5  square  millimeter  transparent  grid  was  placed  over  the  instructor's  vi^'v- 
ing  screen  of  the  Willey  and  displayed  on  a  video  monitor  behind  the  subject. 

This  allowed  the  scorer  to  accurately  determine  the  deviation  of  the  aiming 
cross  from  the  true  center-of-mass. 

Crewmen  in  the  feedback  group  were  Informed  as  to  their  time  to  center- 
of-mass  and  amount  of  deviation  from  true  center  after  each  trial.  Crewmen  in 
the  no  feedback  group  were  not  provided  information  concerning  their  performance. 

ASVAB.  Scores  for  each  participant  on  seven  Armed  Services  Vocational 
Aptitude  Battery  (ASVAB)  subtests  were  obtained  from  personnel  records.  These 
were  Word  Knowledge  (WK),  Mathematics  Knowledge  (MK) ,  Mechanical  Comprehension 
(MC),  Numerical  Operations  (NO),  Arithmetic  Reasoning  (AR),  Electronics  Infor¬ 
mation  (El),  Automotive  Information  (AI)  and  Classification  Inventory-Electronics 
(CE) .  These  subtests  were  chosen  based  on  previous  research  (Eaton,  Bessemer, 
and  Kristiansen,  1979)  which  developed  two  paper-and-pencil  predictors  of  tank 
crewman  performance.  Table  2  shows  how  these  subtest  scores  were  combined  and 
what  predictor  criterion  relationships  have  previously  been  obtained  (Maitland, 
Eaton,  and  Neff,  1980). 

Table  Vl-M.  The  Table  Vl-M  order  of  firing  and  engagement  techniques  used 
in  Phase  III  were  the  same  as  in  Phases  I  and  II  with  the  exception  that  crew¬ 
men  were  not  required  to  fire  a  warm-up  round  at  the  zero  panel.  Scoring  pro¬ 
cedures,  however,  were  different.  Each  engagement  was  videotaped  for  subsequent 
verification  on  a  21"  video  screen.  Two  cameras  were  used,  one  recorded  sta¬ 
tionary  engagements  at  1000m  and  1400m  by  means  of  a  lOOOram  telescopic  f  “  5.6 
lens,  the  other  recorded  the  moving  engagements  at  700m  using  a  500mm  telescopic 
f  =  5.6  lens.  The  cameras  were  situated  approximately  25m  to  the  left  or  right 
of  the  firing  tank.  The  direction  selected  offered  the  least  amount  of  obscura¬ 
tion  during  firing  from  smoke,  dust,  or  heat  distortion,  etc.  The  video  tapes 
were  played  at  a  later  date  for  scoring  by  two  experimenters  (see  Appendix  H 
for  sample  score  sheet).  The  playback  equipment  allowed  a  frame-by-frame 
analysis  that  could  easily  detect  rounds  passing  through  holes  produced  by 
previous  rounds. 

DATA  HANDLING 

Tracking  Data.  The  tracking  task  was  quantified  to  yield  six  separate 
measurements  of  tracking  performance  for  each  participant.  Three  were  related 
to  tracking  time  and  three  to  tracking  error.  These  measures  were  obtained  by 
computing:  1)  the  mean  error  and  time  scores  for  the  first  four  trials,  2)  tl.c 
mean  error  and  time  dcores  for  the  last  four  trials  (l.e.,  trials  17  through 
20),  and  3)  the  difference  between  means  for  time  and  the  difference  between 
means  for  error. 
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Table  2 


ARMED  SERVICES  VOCATIONAL  APTITUDE  BATTERY  (ASVAB)  BASED  ARMOR 
CREWMEMBER  SELECTION  TESTS 


Predictor 

Tests 

Combined  Standardized 

Subtest  Scores* 

Correlation 
with  Criterion** 

Gunnery  U7K) 

Word  Knowledge  (WK) 

Mathematics  Knowledge  (MK) 

Mechanical  Comprehension  (MC) 

.29*** 

Driving  UMO 

Numerical  Operations  (NO) 
Arithmetic  Reasoning  (AR) 
Electronics  Information  (El) 
Automotive  Information  (AI) 
Classification  Inventory- 

.40*** 

Electronics  (CE) 

^Foxuiulae  from  Eaton,  Bessemer  and  Kristiansen  (1979) 
^^Correlations  from  Maitland,  Eaton,  and  Neff  (1980) 
***£  <.001 
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bcnrilng  Oatci,  Thf.  tiatf.-  obtained  from  the  Dancing 
In  Phase  II,  by  coii.puulng  the  mean  numbof  of  f:rrors  for 
by  t!ie  part.fo.f  pant  fi, 


cask  v;as 
the  25 


qiiantif ied^  as 
trials  complfited 


Center^ol -Mass  Da  L  ^ Pour  maasures  v.’ara  obtained  from  the  center-of-mass 
cask:  1)  the,  .iiean  t 'Uiio  for  CiTi&I.s  five,  through  eigVh;,  2)  the  difference  be¬ 

tween  C(ie  time  .msans  foi:  trials  one  Ihrongh  four  and  five  through  eight, 

3)  the  mean  numhei:  of  orruvs  ior  tJ.'iaXf;  live  i.i)i;oijgh  oignt,  and  the  differ¬ 
ence  between  error  li'ean.u  ior  rriais  one  rhrougb.  four  and  I'iva  through  eight. 


ASVAB  beta.  Ro’.-,'  scores  for  three  of  the  seven  ASVAP  subtescs  were'  suDuned 
to  yield  a  predictor  c.clled  Live  Gunuen'y  UMS.  These  subtescs  were  WK,  MR,  and 
MC  (sea  Table  2).  The  raw  ucoves  f  r.:  che  rei(ia.ui j ug  four  subtescs  were  sumned 
CO  form  another  p -(U" iotoi;  ru'Lerreu  to  as  I'rivlng  UMS.  These  subtests  were  NO, 
AR,  hi  5  .'VI  ^  aiw!  OF.  \  Ta!!.l.  -.  2).  Cuuuer;/  t.'ftS  and  Driving  UMS  were  summed  to 

provide  a  third  prnr- tcivn .  Cti  adaiiiou,  :  iv;  three  raw  scores  used  to  obtain 
the  Gunnery  UhS  wort  tonverted  to  standard  scora.o  with  a  mean  of  100  and  a 
standard  devIatio.a  'oi;  13,  then  sun.iiicd  to  yicj.d  a  fourth  j;redictor  I'ef erred  co 
a.s  thn  Gunnery  \TK'  (Fatoii,  Bessemer  and  Kristiansen,  D.979).  The  use  of  the  UMS 
and  UMO  iiot.stion  i.;':  bn.sed  iu.h'u  f ortitu.'l.;u;  piTaentod  iu  Maitland,  Eaton,  and  Huff 
(1980).  UMO  rt’l'u.rs  co  uuit-we:. jOu-o';  mod"!'--  thal  contain  only  .standardised 
ASVAB  sub.tG.'Sl;s .  UM.':'  refers  to  uu.it-v/eightcd  modois  containing  only  raw  .scores 

from  ASVAB  sub  tests- 


Tabl e  VI- M  D^t:a.  Tank  gunncj.*y  (Table  VT-M)  performance  measures  included 
number  of  movinu,  t.^rget  hit.s,  numbor  of  round  hits,  number  of  second 

round  hits.,  and  numb'ir  o,f  total  liit.-i.  These  scores  were  converted  to  _z  scores 
on  .?i  company  by  comj  stry  basis  because  n;.i  two  compiuiies  fired  the  same  tank  on 
the  same  clay, 

RFSUT,i’3 


JOB  SAfrPLE  REI,AT'fONS-aPS 


A  two-way  multi',  ariatc  analysis  of  variance  (MANOVA)  was  performed  to 
determine  if  level  o>  prior  training  had  a  significant  effect  on  the  perfor¬ 
mance  of  four  job  sample  tasks.  Results  of  this  analysis  revealed  a  signifi¬ 
cant  difference,  beew*  en  the  task  purformanen  of  Reception  .Station  (no  prior 
trnln.ln,'0  and  BAT  (eight  wneka  of  training)  pornonne,!  (K  ■  211.76;  £  <.0001). 
Post-hoc  an  I  vnj: !  .'I  to  .'uiriJ.yse.s  for  tracking  urror,  sensing  error,  and”  centcr-of- 
mass  error  revealed  ?  significant  .level  of  cr.nin.lng  main  effect  F  *  27.128; 

£  <.0001;  F  -  39.295;  <.001:  and  F  =  i>.33;  p  <.0001,  re.spectively  for  the 

three  tasks.  Tlicre  was  no  difference  between  Reception  Station  and  BAT  per¬ 
sonnel  for  the  center-of-ma.'^s  (COM)  time  job  .s.’jmplc  task.  As  can  be  seen  in 
Table  .3,  BAT  pci:.sonnr I ,  on  the  average,  performed  better  on  job  sample- tasks , 
i.e.,  made  fewer  error.s)  or  were  faster  than  the  Rece.ption  Station  personnel. 
The  exceptions  to  thi.s  were  that  BAT  personnel  in  both  the  feedback  and  no 
feedback  groups,  made  more  errors  on  the  sensing  t.isk  and  the  BAT  personnel  in 
the  feedb.'ick  gxoun  took  longer  to  locate  the  center-of-mass  than  did  the 
Reception  Station  personnel. 
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To  deceri’iine  wheilier  or  not  the  Reception  Station  personnel  differed  from 
BAT  personnel  in  tank  gunnery  pei  fonnance ,  £-  tests  were  performed.  No  dif¬ 
ference  was  found  between  the  two  groups  for. total  hits,  moving  target  hits, 
first  round  hits,  or  second  round  hits. 

The  second  factor,  in  tiie  two-way  MANOVA  was  type  of  feedback  (i.e., 
presence  or  absence  of  feedback) .  The  results  of  this  analysis  revealed  no 
difference  in  job  sample  t.isk  performance  between  indiviuuals  who  received  in¬ 
formation  concerning  tiieir  performance  and  those  who  did  not,  for  any  of  the 
four  tasks.  Neither  was  there  an  Interaction  betv/een  Irv^ei  of  training  and 
type  of  feedback.  Ic'  determine  whether  the  feedback  and  no  feedback  groups 
could  be  coJlap.jed  under  tlicir  respective  ie’^els  of  training,  tests  of  colin¬ 
earity  were  performed  (Kirk,  I9cd,  p.  a71).  None  were  significant.  Therefore, 
because  there  were  no  differences  found  betv?een  means  end  the  hypothesis  that 
the  overall  regression  line  wan  1 cuea.:  could  not  be  rejected,  the  distinction 
between  the  feedback  aiui  no  feedback  groups  within  levels  of  training  in  sub¬ 
sequent  analysis  was  not  retained. 

TANK  GUNNERY  RELAT  tONSllIPS 

All  participa:  ta  for  '..'''xi.'  complete  job  sarap.'i.(.>  and  gur.nery  data  sets  were 
available  (31  Reccptiicn  rt.. '..icr,  .and  3'  ’lAi')  were  inc.Jidcd  in  subsequent  analyses. 

Tracking:  Tank  Gunnery  Rc.lat .mrish ip.s .  Correlations  were  computed  becw’een 
each  of  the  six  track.iig  ta.uk  mea.sures:  and  three  of  the  tank  gunnery  measures 
(total  hits,  first  round  ami  t'oving  hits)  for  both  Reception  Station  and  BAT 
level  personnel.  A  oignif  J.cant  relationship  was  obsorve(;  between  mean  tracking 
time  (trials  17  through  20)  .'•.nd  number  c'f  moving  target  nits  for  the  Reception 
Station  personnel  (r  -  .3i;  <,03).  ’^nutcr  trackl.ig  times  were  associated 

with  more  moving  target  hits. 

For  BAT  leva),  personnel,  four  sign  i. i  I'-ant  iraciuing  task-tank  gunnery  re¬ 
lationships  v;are  observed.  Si gn i.i' leant  ro.i.n! 'ons'nip:'.  'ware  observed  between 
the  difference,  scori-  for  r.rncl:i!‘.g  time  and  both  first  round  and  total  number 
of  hits  (r  -  .26;  £  '.03  and  r  .31;  £  <.05).  Significant:  relationships  were 
also  observed  bctvjeen  t’'e  i  fieret'ct'  sc.ov.,:  for  ir.uk'ng  cr-or  and  both  first 
round  and  totai  number  of  lilts  (r  ■-  .  .24 ;  p  -.Oi  and  r  =  .25;  £  <.05).  A  com¬ 
plete  Inter-correJ  iti on  matr  ix  for  Potii  Kcc'’ptJon  Star  ion  and  BAT  level  person¬ 
nel  is  provided  in  Apurnu' ix  1 

Senn  i  ng:  i'anr,  ..inrn^ry  Re  i.a c  j  nno'r  ■  ps  .  (.i  rrclac.ion:.  vjore  computed  between 

mean  number  of  nens.ing  ormr.'-'  an  I  t  •.  i  '  a.nk  gunnery  r.easuT es  (second  round  hits 
and  total  I'lts)  ior  iiotb.  Rocep'ion  S.t.itlnn  and  BAT  ieve.:.  personnel.  Contrary 
to  the  finr  l.ngn  lu  Ptia.sea  I  and  li  imin  OSUT  girdduare.s,  sensing  was  not  found 
to  be  related  to  loci'  gunnary  per  fonnance. 

Center-of-Mass : _ Tani-  Gunnery  Reiatlonahlps .  Correlations  were  computed 

between  four  separate  measures  of  center-of-mass  task  performance  and  two 
measures  of  tank  gunr.’ty  performance  (ffrst  round  lilts  and  total  hits).  No 
significant  reiationships  w.-re  observed 

ASVaB.  TanR  iiur.aery  '  a  t  ..oii.in j.p:',  .  j  ptirr  1  cipar.CE  for  whom  complete 
Job  sample,  ASVAB,  a:.d  ga  raory  d,iwa  :;cts  were  available  (30  Reception  Station 


means  and  standard  DZriATIONS  FOR  RECEPTION  STATION  AND  BAT  PERSONNEL  FOR  FOUR  JOB  SAMPLE  TASKS* 


and  33  BAT)  were  included  in  subsequent  analyses.  None  of  the  four  ASVAB  de¬ 
rived  measures,  Gunnery  UMS,  Gunnery  UMO,  Driving  UMS,  nor  Gunnery  plus  Driving 
UMS,  was  related  to  total  number  of  Table  VI  hits.  Complete  correlation 
matrices  are  provided  in  Appendices  J  and  K. 

DISCUSSION 

The  purpose  of  this  research  was  to  determine  the  effects  of  two  variables, 
type  of  feedback  and  level  of  prior  training,  on  job  sample  task  performance 
and  on  job  sample-tank  gunnery  relationships.  The  results  of  Phase  III  testing 
revealed  no  difference  on  job  sample  performance  for  participants  receiving 
feedback  versus  those  who  did  not.  This  lack  of  difference  may  be  accounted 
for  by  the  concurrent  intrinsic  feedback  present  in  the  selected  job  sample 
tasks.  For  example,  the  gunner's  controls  on  the  Willey  BOT  trainer  modulated 
the  position  of  the  sight  reticle  relevant  to  the  target  while  the  eyepiece 
allowed  him  to  obtain  constant  information  concerning  the  effect  his  responses 
had  on  the  position  cC  that  reticle.  In  the  sensing  task,  participants  were 
provided  feedback,  net  after  each  round,  but  after  each  five  round  engagement. 
This  meant  that  tliey  were  given  information  concerning  their  performance  on 
a  given  target  slide  just  prior  to  commencing  a  new  five-round  engagement  on 
a  new  target  slide.  Thus  the  participants  may  not  have  had  the  opportunity  to 
apply  the  information  they  received  within  the  specific  context  in  which  it 
would  have  been  most  profitable  *i.e.,  on  the  original  target  slide).  Future 
research  efforts  should  closely  evaluate  the  time  of  feedback  (e.g.,  immediate, 
delayed,  etc.),  the  iorm  of  feedback  (e.g.,  millimeters,  number  of  errors, 
lapse  time,  etc.),  and  the  quantity  of  feedback  relative  to  the  capacity  of 
the  capacity  of  the  c-jiticipant  to  process  information  in  the  allotted  time. 

Significant  difi ercncen  were  revealed  in  Phase  III  between  personnel  with 
no  prior  training  and  personnel  in  tlieir  eighth  week  of  Basic  Armor  Training 
on  three  job  sample  tasiis.  Kewevar,  no  difference  in  job  sample  task  perfor¬ 
mance  was  found  for  participants  in  the  feedback  and  no  feedback  groups. 

Several  of  the  reiat iousUip.s  between  job  sample  measures  and  tank  gunnery  per¬ 
formance  found  in  Phases  I  and  J.I  of  this  research  did  not  obtain  in  Phase  III 
when  personnel  who  had  no  hands-on  gunnery  experience  served  as  research  par¬ 
ticipants.  However,  one  new  measure  method,  difference  scores,  did  show 
promise.  Finally,  no  relationship  was  found  between  ASVAB  based  gunnery  pre¬ 
dictors  and  performance  of  gunners  in  iheir  first  live  firing  experience. 

Phase  I  and  II  lescarch  participants  were  recent  Armor  OSUT  (MOS  19E) 
graduates  who  wore  tested  on  Job  s.smpic  tasks  at  the  end  of  their  13th  week  of 
training  Just  prior  t;o  their  first  live  firing  experience.  However,  Phase  III 
participants  had  no  fonnal  gunnery  training  or  very  little  prior  to  job  sample 
testing.  The  finding  of  significant  differences  between  the  two  groups  in 
Phase  TIT  on  Job  sample  tasks  most  likely  reflects  the  fact  that  job  sample 
scores  are  quantifying  components  of  performance  which  are  affected  by  experi¬ 
ence.  Thus,  contrary  to  the  suggestion  made  based  on  Phase  II  results,  previous 
methods  of  quantification  must  necessarily  be  measures  of  achievement  rather 
than  aptitude.  For  this  reason,  a  new  method  of  quantifying  job  sample  perfor¬ 
mance  which  took  into  account  prior  experience  or  training  was  evaluated.  This 
method  relied  upon  the  use  of  difference  scores. 


The  Phase  III  accempu  to  quatiCify  LmproveiiipuC"  and  remove  initial  profi¬ 
ciency  level  from  che  nieasure-j  by  the  use  cf  difference  scores  >  provided  some 
degree  of  promise  at  the  I5AT  level.  Because  difference  scores  may  reveal  the 
amount  of  Improvement  over  trials,  the  slgnificanl  positive  correlations  which 
were  obtained  indicate  that  tl'.a  ;;raarcr  the  improvement  the  greater  the  number 
of  first  round  hits  and  the  higlier  the  total  number  of  hits.  Thus,  difference 
scores,  in  a  rather  erode  form  are  ir.easureo  of  tlu-.  "ability  to  learn."  It  is 
this  ability  to  learn  which  is  '.fren  rfifarred  to  as  aptitude.  To  .*^ind  measures 
which  are  predictive  of  tuture  pej  furmance  Irut  are  not  .severely  affected  by 
training,  one  must  first  identify  aptitudes  Matfiodology  must  then  be  developed 
to  appropriately  mea.'^ure  these  aptit.ides.  Future  researen  must  concentrate  on 
determining  the  most  suitable  rsethoda  for  'iuar!tify.'.nt;.  the  job  samples  that  have 
already  been  identified  as  critical  "opt Ltudc-containing'  components  of  spe¬ 
cific  tasks. 

The  failure  of  L'le  ASVAB  based  paper-£‘id--par.cii  predictors  to  cross- 
valldate  to  new  samples  came  os  no  surprise  and  served  to  provide  continued 
support  for  the  Eaton,  Bessemer,  and  Kristiansen  (19/9)  proposal  that  research 
efforts  should  be  directed  tov.’ard  job  sample  and  sniinulacor  techniques  for  pre¬ 
dicting  gunnery  performauce .. 

SUMMARY  AMD  CCHULUSIOKS 

The  research  reported  hereiii  \-:as  designed  re  evaluate  several  job  sample 
predictors'  gunnery  per formauca.  In  th;;  fir.st  phase  o.'  the  research  a  variety 
of  job  sample  measures  rere,  evottuated .  T'isse  includec  several  measures  of 
tracking,  sensing,  and  "yund  acljustmenL  ta.9ks.  Tracking  a  diamond  figure  and 
round  sensing  were  bot’n  rt.;ated  to  gunnery  perfortioiicG,  The  fewer  errors  a 
gunner/loader  ’ntidt  on  th.soe  ta.jk.s,  the  natter  be  fired  the.  tank  main  gun. 

Job  sample  measures  v.-hrcii  were  related  to  guiniery  performance  in  the  first 
phase  of  the  research,  were  ;‘e-evalua te."  ••,•11. n  a  ric;,'  sample  of  research  partici¬ 
pants  in  the  second  puase  of  the  research..  In  addliion,  a  unit-weighted  pre¬ 
diction  model  and  a  s!  s.'laru  regression  modvai.,  based  or.  Phase  I  results,  were 
applied  to  Phase  11  r.tn  .its.,  ac coanting  for  approxiut.afely  35%  of  gunnery  vari¬ 
ance.  Moreover,  comparison  of  job  sample,  scores  cf  personnel  who  were  either 
given  extensive  training  (e.g.,  guaner/ioadara) ,  .-jr  little  training  In  gunnery 
(e.g.,  drivers),  was  lucorprcted  as  suggest. "Inr;  that  the  observed  relationships 
were  best  attributr.bJ  =■  to  measurt.man t  of  aptitude  taulier  tlian  achievement  level. 
Consequently,  the  job  sample  _e'.  hnique  was  der-or  rbed  as  holding  promise  as  an 
assignment  tool  Cc  ■'  j.'e  L  ••inc.,:  •'l.ig  gur.r.crv  t'taln.tng  nrogram.s. 

However,  in  the  t';, ■/■.;!  phar'c  of  :e.''carcir.  -■•'le.i’i  previour-iy  evaluated  job 
samples  were  re-ev.?.i..ja::ci',  .-.■i  th  i 't  ’  "Ipant:;  rrom  tlie  Reception  Station  (l.e., 
individuals  having  no  , plane. •>’  troining)  and  from  eighth  week  of  BAT  (Basic 

Armor  Training),  a  del  1 1  i...;U'.:.i  I  effect  •yv’.  L'le  •r.r'ivieusly  identified  job  sample  — 
tank  gunnery  relatlcn.sh  i.|>a  wa.s  acted  ':’hus  ;.  iie  -mpii.asis  change  from  what  could 
be  referred  to  as  conaut  tent  ,:c  u;-'trcn  to  pro.:!  let  t  ve  research  seemed  to  have  & 
degrading  effect  cpd  job  sample  eiai  ioi.ahlps..  Tlie  sagge.sL ion  from  Phase  II 
that  the  job  sample  t.asks.  .ns  n'..->as-ired,  rcfli^cr.ed  aptitude  rather  than  achieve¬ 
ment  had  to  be  ••aconsidf'rr'ri .  A-;  n  rr,.;ii(  i.be  method  r>t  quantifying  job  sample 

tests  was  changed  to  n'l'^c'c  Lnii);  ...v;  t  j  -,-,  .'erforn.inco  over  time  rather  than 
absolute  level  ai;  per'M  ,  auu  m.any  of  .  n.:-  •re.lj.tioc.ships  wei’e  once  agair. 

observable  —  at  least  for  bAT  .tevei  personnrl. 


The  critical  aspect  of  job  samples  as  tank  gunnery  performance  predictors 
appears  to  be  the  methods  used  to  quantify  task  performance.  These  methods  must 
account  for  prior  experience  (i.e.»  training)  and  accurately  reflect  the  in¬ 
dividual's  potential  for  acquiring  the  necessary  skills. 

Job  samples  and  associated  simulation  techniques  show  excellent  promise  as 
predictors  of  tank  gunnery  performance.  Future  research  must  place  an  emphasis 
on  the  aptitude  measurement  methodology  used  to  quantify  both  the  Job  sample 
tasks  and  the  performance  criteria. 
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APPENDIX  A 


SEQUENCE  OF  CONSOLE  SETTINGS  FOR  FCCS  ENGAGEMENT  SmUlATlOtfS 


Ik  SdUoti I  L|  lOOOni 

2.  Heat,  L,  lOOOm 

3.  Sabot,  R,  lOOOn 

4.  Hep,  L,  1000m 
5*  Heat,  R,  1000m 
6.  Hep,  R,  1000m 

1.  Sabot,  L,  2500m,  Start  Range,  Stop,  1500m,  Start 

2.  Heat,  Start 

3*  Sabot,  R,  1000m,  Start,  Range,  Stop,  1500m,  Start 

4.  Heat,  Start 

5.  Heat,  L,  2500m,  Start,  Range,  Stop,  1500m,  Start 

6.  Sabot,  Start 

7.  Heat,  R,  1000m,  Start,  Range,  Stop,  1500a,  Start 

8.  Sabot,  Start 

9.  Sabot,  R,  1000m,  Start,  Range,  Stop,  1500a,  Start 

10.  Heat,  Start 

11.  Heat,  L,  250(Xn,  Start,  Range,  Stop,  1500m,  Start 

12.  Sabot,  Start 
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TABLE  VI-M 


Engage¬ 

ment 

Target 

Range 
in  meters 

Engagement  Technique 

Ammunition 

1 

Zero  panel 

1200 

Precision  Periscope 

HEAT 

2 

Stationary  panel 

1000 

Precision  Telescope 

HEAT 

3 

Moving  tank 
silhouette 

700 

Battlesight -Periscope 

HEAT 

4 

Stationary  panel 

1400 

Precision  Periscope 

SABOT 

5 

Moving  tank 
silhouette 

700 

Precision  Telescope 

HEAT 
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PHASE  I  MEANS,  STANDARD  DEVIATIONS,  AND  INTERCORRELATION  MATRIX 
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PHASE  II  MEANS,  STANDARD  DEVIATIONS  AND 
INTERCORBELATION  MATRIX  (N-24) 
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PHASE  nr  TRACKING  TASK  INSTRUCTIONS 


At  this  station  you  will  participate  In  a  tracking  task.  You  will  use 
this  equipment  to  perform  the  tracking  task. 

1.  These  are  hand  controls  (point). 

2.  This  Is  the  palm  switch  on  each  side  (point). 

3.  The  hand  control  works  only  when  the  palm  switch  Is  depressed  (show) 

(move  +  to  center). 

4.  Put  both  hands  on  the  controls,  look  through  the  eyepiece  here,  and  depress 
the  palm  switch. 

5.  Turn  the  hand  control  to  the  right  to  make  the  crosshair  appear  to  move  to 
the  right;  —  do  it  now.  (KELP  IF  NEEDED.) 

6.  Turn  the  hand  control  to  the  left  to  make  the  crosshair  appear  to  move  to 
the  left;  —  do  it  now.  (HELP  IF  NEEDED.) 

7.  Rotate  the  hand  control  back  to  make  the  crosshair  appear  to  move  up;  — 
do  it  now.  (HELP  IF  NEEIED.) 

8.  Rotate  the  hand  control  forward  to  make  it  go  down;  —  do  it  now.  (HELP 
IF  NEEDED.) 

9.  To  go  on  the  diagonal,  up  and  left,  turn  the  control  to  the  left,  and 
rotate  backward;  —  do  It  now. 

10.  To  go  down  and  right,  turn  tha  control  to  the  right,  and  rotate  forward;  — 
do  it  now. 

11.  Go  back  to  the  center. 

12.  To  go  down  and  left,  turn  left,  and  rotate  forward;  do  It  now. 

13.  To  go  up  and  right,  turn  right  and  rotate  backward;  do  it  now. 

14.  The  more  you  turn  the  controls  in  one  direction,  the  faster  the  cross¬ 
hair  moves. 
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You  are  to  track  this  diamond  design  (indicate)  by  keeping  these  (indi¬ 
cate)  cross-hairs  in  between  the  two  lines  (Indicate).  You  will  start  from 
here  (the  top)  when  I  say  "go"  and  track  in  the  direction  I  indicate.  When 
you  get  back  to  the  top  I  will  say  "stop."  You  will  be  scored  on  how  fast 
you  track  the  design  and  how  many  errors  you  make.  An  error  is  scored  when 
the  center  of  the  cross-hair  touches  the  black  lines  or  goes  outside  the 
black  lines.  Now  1  will  give  you  2  trials  to  practice.  (Show  the  man  how 
to  track  the  design  —  once  to  the  left  and  once  to  the  right  —  and  then 
allow  the  man  two  minutes  of  practice). 

Now  we  are  going  to  score  your  next  20  trials. 

Feedback  Only;  At  the  end  of  each  trial  1  will  tell  you  how  long  it 
took  you  to  track  the  design  and  how  many  errors  you  made. 
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PHASE  III  SENSING  TASK  INSTRUCTIONS  . 


"At  this  station  you  will  participate  In  a  sensing  task..  The  purpose  of 
this  task  Is  to  determine  If  you  can  locate  a  flash  of  light  on  this  screen." 

At  this  point  the  T-scope  was  opened  until  the  participant  identified  the 
simulated  round.  He  did  not  record  his  sensing  of  the  round.  Once  he  was 
sure  of  the  location  of  the  round,  the  cycle  was  started  to  close  the  T- 
scope.  Then  the  researcher  continued  to  read  the  instructions.  "That  is  what 
It  will  look  like,  but  it  will  only  appear  for  a  brief  moment,  like  this." 

The  start  button  on  the  T-scope  was  pressed,  at  this  point,  to  allow  for  a 
simulated  round  flash  to  occur.  The  researcher  would  point  to  the  approximate 
location  of  the  flash  to  facilitate  the  participant's  sensing  of  the  flash. 

This  would  be  repeated  as  many  times  as  necessary  to  insure  that  the  partici¬ 
pant  could  see  the  flash.  He  did  not  record  his  sensing  of  the  round.  Then 
the  researcher  returned  the  target  slide  projector  to  the  first  target  slide 
and  continued  to  read  the  instructions.  "There  will  be  one  flash  at  a  time  and 
I  will  announce  "on  the  way"  prior  to  each  flash.  I  have  given  you  five  pic¬ 
tures,  one  for  each  of  the  slides  you  will  see.  For  each  slide  there  will  be 
five  flashes  on  or  near  a  target  that  1  Indicate.  Your  task  is  to  locate  the 
flash  on  the  slide  and  place  a  dot  in  the  same  spot  on  the  picture.  In  addition 
you  will  place  a  number  beside  the  dot  to  indicate  which  flash  in  the  sequence 
you  just  recorded.  I  will  tell  you  the  number  to  record."  This  was  done  prior 
to  giving  the  "on  the  way",  i.e.,  "number  one  on  the  way".  "If  you  are  unable 
to  see  the  flash  write  "lost"  and  the  "number"  In  the  top-right  hand  comer  of 
your  picture." 
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Feedback  Only;  "At  the  end  of  each  five  round  sequence  I  will  score  your 
paper  and  tell  you  how  many  millinetera  your  recorded  flash  is  from  the  true 


location." 
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APPENDIX  G 

PHASE  III  CENTER-OF-MASS  TASK  INSTRUCTIONS 


PHASE  III  CENTER-OF-MASS  TASK  INSTRUCTIONS 


"In  this  task,  you  will  be  required  to  move  the  cross-hairs  from  the 
center  dot  (identify)  to  the  target  I  designate,  and  place  the  cross-hairs 
in  the  center  of  that  target.  Do  this  as  quickly  as  you  can.  You  will  start 
on  my  command  "go".  Vfhen  you  have  the  cross-hairs  on  the  center  of  the  tar¬ 
get,  stop  moving  the  hand  control,  and  fire,  as  I  do  now."  (Scorer,  stop  the 
clock  at  this  point.)  "After  you  "atop,"  fire  a  three  to  four  round  burst  and 
then  move  the  cross-hairs  back  to  the  center  dot.  You  will  be  given  eight 
trials  and  each  will  be  videotaped.  Do  not  fire  "on  the  move"!" 

Feedback  Group  Only;  "At  the  end  of  each  trial  you  will  be  told  how  long 
it  took  you  to  locate  the  center  and  fire,  and  the  number  of  units  you  were 
off  the  center." 

"Are  there  any  questions?" 

Scorer  Instructions 

Have  the  man  locate  the  center-of-mass  for  the  targets  in  this  order! 
Ist-top  left  target;  bottom  right  target;  3d-top  right  target;  4th-lower  left 
target . 

Record  total  time  from  "go"  to  "fire." 
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TABLE  VI  TANK  GUNNERY  SCORE  SHEET 
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TABLE  VI  TANK  GUNNERY  SCORESHEET 


First  Round  Hits 


Second  Round  Hits 


0  1  2  3  4  5 


Total  Nunber  of  Hits 


0  12  3  4 


Ver 

YES 


'/erified  by  Hole  Count? 
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PHASE  III  MEANS,  STANDARD  DEVIATIONS 
AND  INTERCOHHELATION  MATRIX  FOR  RECEPTION  STATION  (N-31) 
AND  BAT  PERSONNEL  (N-57) 
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PHASE  III  MEANS,  STANDARD  DEVIATIONS,  AND  INTERCORRELATION  MATRIX  FOR  RECEPTION  STATION  (N=31) 

AND  BAT  PERSONNEL  (N=57) 


lQ.33(5.f)i)  30.11(4.84)  40.20(7.53)  14.49(7.08)  33.25(4.84)  1.25(1.37)  2.70(2,37)  2.31(1,74)  .92(.60)  .*0(.72) 


APPENDIX  J 

PHASE  III  MEANS p  STANDARD  DEVIATIONS 
AND  INTERCORRELATION  MATRIX  FOR  RECEPTION 
•  STATION  PERSONNEL  (N=30) 
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PHASE  III  MEANS,  STAND^iJlD  DEVIATIONS,  AND  INTERCORRELATION  MATRIX  FOR  RECEPTION  STATION  PERSONNEL  (N»30) 


APPENDIX  K 


PHASE  III  MEANS,  STANDARD  DEVIATIONS, 
INTERCORRELATION  MATRIX  FOR.  BAT  PERSONNEL 
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PHASE  III  MEANS,  STANDARD  DEVIATIONS,  AND  INTERCORRSLATION  MATRIX  FOR  BAT  PERSONNEL  CN=33) 
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